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ABSTRACT 



Weaknessc-s in educational softv/are currently available in the domain of 
mathematics are discussed. We present a technique that we use for the 
design and production of mathematics software aimed at improving 
problem-solving skills which combines sound pedagogy and innovative 
programming. To illustrate the design portion of our technique, we 
present a "storyboard" for a sample problem from elemetary algebra. 
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The increased availability of microcomputers in the late 1970s was viewed 
with high hopes by many in the educational coirjnunity. Si„c- then, the 
presence of computers in the classroom has met with mixed reviews. There are 
a number of reasons for this response. They include the ambivalent attitudes 
of teachers, students and school administrators toward computers, the high 
costs of computer hardware and software, ant. the poor quality of much of the 
educational software now available. In this paper the major £,hortcoming3 of 
currently available educational sof ware will be discussed. in addition a 
design strategy for overcoming these weaknesses will be presented. Finally, a 
"storyboard* will be presented as an example of one stage of this design 
strategy. 

The most significant shortcoming of .available mathematics educational 
software is the paucity of material devoted to teaching problem solving 
skills. The National Assessment of Educational Progress (1983) survey found 
that most students did well in exercises that assessed routine math skills, 
but performed poorly on multi-step prob..efns which assessed higher level 
cognitive skills. For example, both research and remedial matheniatics 
instruction conducted by our group indicate that translating statements 
expressing mathematical r xationships into algebraic notation is very 
difficult for most students, in light of these findings our primary goal has 
been to develop educational software which will both assess and improve 
problem solving skills. 

Another serious problem with existing educational software is that it iS 
unimaginative. This problem occurs because most software designe-s insist on 
using printed teaching aids, such as workbooks, as theit model. Such an 
approach ignores the unique capabilities of the computer. Consequently, 
software developed in this way is of the drill-and-practice or electronic 
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workbook type in which little meaningful interaction is required on the part 
of the student. In this type of coftware student interaction is limited to an 
occasional yes/no response or to answering multiple choice questions, in 
other words the computer display mimics a printod p=5ge, VUth over 90% of 
available mathematics software being of this type, it is not surprising that 
;nany teachers and schw^l administrators are anJbivalent about computer-assisted 
instruction. In this period of tight budgets school administrators cannot be 
expected to invest in expensive "ueaching oiachines" which are no better than 
traditional educational material. In future applications, the computer's 
analytic power and large memory capability must be used to create a more 
flexible learning environment which can respond to individual student needs. 

Our primary goal in developing mathematics educational software is to 
produce a pedagogical ly sound learning environment which uses the cc^nputer's 
unique capabilities , One of these capabilities is tho computer's ability to 
analyze and respond to free-form answers. For example, suppose we want to see 
if the user understands a certain functional relationship. To do so, we could 
have the computer ask the i aestion, "What happens to Y as X increases?* One 
unexciting way to elicit a response is to ask ^rhe user to select from among 
the multiple choices: a) increases, b) decreases c) stays the same. Responses 
of this kind leave very little opportunity for the computer to analyze error 
patterns. A FDre interactive approach would be to let the user input a 
free-form response- This would give the user the freedom to choose from a 
number of possible answers, such as "increases", "gets bigger" or "shrinks", 
which the computer could later interpret. Given the analytical power of 
computers, recognizing a number of acceptable free-form answers is a perfectly 
reasonable feature to incoporate into the software. In the odd event that the 
student's response is not in the set of recognizable choices, a message would 
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be displayed on the screen telling toe user that the computer cannot recognize 
his/her answer and that s/he should try to respond in a different way* 

A more important reason ror using free-form' responses is that they allow us 
to look for error patterns which may be indicative of student misconceptions. 
This featu.e is important because in many cases these misconception:^ interfere 
with learning. A number of research studies conducted by our group (Clement, 
1982; Clement, Lochhead and Monk, 1981; Lochhead, 1980; Mestre, Gerace and 
Lochhead, 1982; Mestre and Lochhead, 1983; RosnicN, 1981; Rosnick and Clement, 
1980) have revealed that a wide spectrum of people are not able to correctly 
translate statements relf^.ting two variables into algebraic equations. We have 
'consistently foi^^'i the same difficulties among stude.'^ts fron five distinct 
cultural groups, among college undergraduates majoring in technic::! Tlc'^ds like 
engineering, and among both high school and college faculty membetc. These 
studies reveal two misconceptions which are very difficult to overcome. One 
consists of translating the mathematical statements into algebraic equations 
using a left-to-right word-order mc-tch with, little regard to the mathematical 
content of the statement. The other consists of treating mathematical 
variables as if they were labels. 

our findings also indicate that students who hold a particular 
misconception do not reach the appropriate level of understanding when they 
are simply shown the correct answer or solution. This evidence suggests that 
misconceptions are deep-seated and require a sustained effort to be 
dislodged. However, once these misconceptions are dislodged students are e^ble 
to accomodate the correct concepts. In response to these findings, we suggest 
the following guidelines when designing math problem-solving software. First, 
the software should anticipate student misconceptions, in order to accomplish 
this goal designers must be familiar with common error patterns that students 
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reveal when solving the problems of interest. Thie inforniation can be 
obtained by consulting appropriate studies in educational research; if 
research on the types of problems of interest is not available, then a pilot 
research study can help identify areas ^b'^te students experience 
difficulties. With a good understanding of those areas that cause 
difficulties, software can be designed that will detect common error patterns 
by analyzing the free-form responses of the student. Next, a conflict must be 
established in the student's mind between his/her answer and the correct 
solution to the problem. This can ber accomplished by means of a series of 
carefully designed questions in the form of a computer-directed 'Socratic 
dialogue'. Tn this part of the program the student is led by a series of 
logical steps to the realization that his/her answer is inconsistant with some 
aspect of the problem. pinal."*y, the student is guided through another 
interactive, computer-directed dialogue which helps him/her reach the 
appropriate level of understanding. 

Today's software does not possess features which allow an instructor to 
analyze the cognitive procesr^es used by students engaged in solving problems. 
One way to use computers as an interface between the student's thought 
processes and the teacher's ability to -interact with these thought processes 
is to develop software which keeps a permanent record of student progress 
towards the solution of a problem. The instructor can then make use of this 
information when planning class lectures and tutorials© Including this type 
of feature in software would help inciease the quality of personalized 
instruction within a classroom setting. 

Educational mathematics software is often both designed and coded by the 
same person. We feel that this method should be modified since this person is 
rarely both an expert educator and an expert coder. Software which has been 



inaovatively programmed, complete with video-arcade graphics and sound, but 
which fails to use eifectiVG te.^.ching methoda n^ay provide the student with a 
good time but will do little to educate. Similarly, software which is 
designed soundly from an educational standpoint may fail to motivate if it 
looks uninteresting. obviously what is needed is a combination of sound 
pedagogy and innovative coding. 

Our development approach divides tasks between people with different 
areas of expertise. The design is undertaken oy experts in pedagogy, namely 
teachers and educational researchers, while the programming is carried out by 
expert coders. Separating these two tasks assures that each expert will focus 
on his or her area of .expertise. We should quickly point out that we are not 
advocating that the desirjn and coding tasks be divorced; rather, we advocate a 
collaborative effort in which the coders advise the designers on ways to 
maximally exploit the full power of the computer to accomplish the stated 
aims. For example, educacors may not be familiar with the computer's ability 
to highlight or blink text, to delay before anc' after critical wotds or 
phrases, to produce pictures and graphics, or to divide the screen into a 
number of independent windows. The task of the eoucators in this 
collaboration is to produce a "storyboard* , that is, the detailed flow-chart 
of the content of the odule designating all the decisions, * messages, and 
branch points that will occur at every step along the way. The storyboard is 
then turned over to an expert programmei. who codes the storyboard in the 
appropriate computer language. 

These two factors, an emphasis on improving higher-levex problem-solving 
skills and a division of the design tasks between educators and coders should 
result in software that is both innovative and educationally sound. We now 
provide an example of a storyboard for a problem from elementary algebra. 
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SAMPLE STORYBOARD 

The following seven pajes contain a sample storyboard for the following 
problem: 

The amount of money collected at an auction was I^IOOO more than the 
estimate made by the organizers. If the organizers estimated that E 
would be collected at the auction, write an equation v/hich expresses the 
actual amount of money collected at the auction, M, in terms of E. 

Certain details are not covered in the storyboard, such as the conventions 
that will be adopted by both the designers and the coders to ensure 
consistency. The notation used in the storyboard goes as follows: 
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1) curly brackets are notes to the c^ier (i.e. )• 

2) square brackets denote inputs (i.e, )• 

3) Tests of inputs are enclosed between slashes (i.e. /•••/ )• 

The screen design will make use of techniques such as text highlighting, 
rlashinc,, and graphics. MOc>t of the interaction will make use of the 
following screen design: 



PROBLEM WINUOW / How these portions of 

the screen will be 
used is delineated i n 
the storyboard. 

EQUATION UOX \ 
EQUATION LINE 



MESSAGE WINDOW 



PROMPT WINDOW 
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L (According to soise pre-deterained selection 

process, select a probleo froa the *probleft library' 
and present it in the Problee Uindou) 



(In Message ^indoM, ttrite) 
•Type in your anSHer and press RETURN' 

— > >->->->->->->->->->->-> 2, cinput s$) < ^<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-^<-<-<-<- 

^ { tthere by SI «8 aean a string 

I variable containing a response. 

^ In this case, the response is an equation, 

I Analyze the input character by character as follows: 

I a) Accept and print in the Equation Line any of the folloiting 

^ characters; s, «, e, E, =, I, 0. Print £ and H only in Caps. 

I Accept H, i, E, e, and =, only once; if the student itteopts to enter any of 

^ these a second tue, don't print thea, give a short beep, and 

I Mr:te the folloMing sessage in the Prospt VindoMi 'This character 

^ is only alloMed once.* 

I Note that the set of allowed characters is probles-dependent. 

* The set of allowed characters Mill reside in a data file 
I corresponding to the particular problei. 

^ However, any alloued characters «hich are letter*; siU only be 

I allowed once in any probles. Further, thp equal sign, =, uill 

^ only be allcwed once in any problee. 

^ b) If the student enters / or t, do not print, give short beep, and give 

I the follOMing lessage in Prospt i^indoM: 'The probles dees not require 

^ Bultiplication or division.' 

^ c) H the student enters '.', or '$' do not print, beep, and give the 

I following eessage in the Proipt HindoN: 'The equation can be ;<ntten 

^ Mithout this syftbol.' This »ill apply to all probleAS. 

* d) If student tries to enter any other key, betp, and give the following aessage 
I in Proapt VindOM: 'tie don't recognize that syabol. Try again' 

I As soon as student enters equation, rewrite it 

^ in the Equation Box provided under the Probles UindoM) 

' I 

I ^ 

^ I 

I • ^ 

I 3. /Is Si an equation?/ 

* { That is, does it have an '=' sign 
I »ith soiething on both sidei of it?) 

2 HO l-> (In rroapt UindoH:) >->•>->->-)->->-)-)-)->->-) 

'An equation sust have an 
equal sign. Try again.* 

YES 
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(In Proapt Hindow:) 
I 'An equation avst 

V have an equal 

I sign.* 



I I 




/Is the constant consistent tiith the problea?/ 
(That iS| has the student aade up a constant that is 
not part of the problem. This inforsation is problea- 
dependent. In this case, accept only 1000 and 0. 
H 0 appears in eqn. by itseH, fiake sure it is isol;>ted on one 
side o< the equation. H any other nuober appears 
flash that nuuer in the Equation line^ 



0— >— (In Proapt. H.:) "The nuaber flashing in your 

equation is incorrect. Try again* ->-> 



YES 



5. /Is the syntax of the equation legiti&ate''/ 
(For exaaple, can't accept •A**-B=— C\ 
Heed to have only one operation 
bettitien variables, etc.) 



<-<-<-{In Proapt 

"The for« o* your equation 
loots «itran;2.* 



-<-2 



0 lO- (In Proapt «. ) 

•The fori J your equation —>—>->->->->->->->->■ 
1 looks strange. Try again' 
YES 



I 
I 

(In Kessagp «:} "You soea to be 
hiving soie difficulty. Press: 
T To try again 

S To see the solution to the problea 
Q To quit" 



6. /!s the equation the sase as •H=EMOOO" 
or •«MOOO*E'?/ 



{6ive randoa good response in 
Proapt Uindotii and go to next problea) 
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1 1' 
1 1 

i . 
1 1 
1 1 
1 i 



/Is it •!'?/ 

<- v£S NQ 

r 

V 

/Is it 'B*?/ YES-->--END 

I 
I 

NO 



KO 



/Is It 'S*?/ NO -- 

BEEP — >- 



M 

1 1 

1 1 
I I 

A A 

1 1 
1 1 

A . 

I 1 
1 1 
1 1 
. I i 
I 1 
1 1 
1 I 
1.1 
1 1 
1 I 
1 1 
1 1 
1 1 
1 1 

erJc I 



I 

VES 



(Branch to Problea Solution) 
END OF THIS BRANCH 



7. / Is the equation the saee as 'EMO0O=r;' or MOOO+E^H*'/ 

<-<-<-<-<-<-<-(- HO YES 
I I 

t V 

I {Write in Message Nindow:) 

'Your equation is correct! But usually Me put the variable 

( heir.g asked for on the lelt hand side, like we are noH 

I showing above* 

f (Kait about 8 seconds after this aessage appears. Then 

I erase the equation froa the Equation Box. Re-Krite it in 

f the standard fore, in this case 'M+IOOO*, and highlight it. 

I Then, in Frospt UindoM, nrite the following oessage in 

f highlighted tors:) 



I 'Press Return to go to the next problea* 



->->->->->->->->->-> 



I 

V 

V <-<-<-<-<- YES <-<-(-<-<-<- 8. /Is It sose equation equivalent to H=E+1000?/ HQ->-> 

I ! 



(In Proapt Uindok:) 
•Your equation is correct! It 
HoMever, let's try to write in the 
v.:y the probles asks* ^ 
(Wait 10 seconds and continue) 



/Does the equation begin with K= , where H is variable 
being asked for in the prcblen?/ 



<-^-<-<- YES 

V 



(In Kess^ge yindo»:} 
*Look at the highlighted portion of the 
probles above. This &e;»ns tha^. K should 
be alone on the left hand side of the equation, 
try to rewrite your eouation ^ith i1 alone 
on the left hand side of the sign, and press return.' 
(highlight portion: 'urite an eq ... in teres of E') 



NO 



(In Proapt U. urite and wait 10 .ecor.ds:) 
•Let's write your equation in the way that 
the probles asks and see if it's correct' 



I 



9. /input/ <-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-<- 

1 
1 

J2 



I 



(If ao response in S seconds 



I 



{In Kessage urite) 
'Look at the highlighted portion of the 
probles above. This seans that K should 
bt alone on the left hand side of the equal 
sign. Hit return to continue*' 
(Highlight portion: "write an eq ... in Itrss 
of E\ Wait for student to type in return. H 
sore than 20 seconds pass, flash the phrase 
•Hit return to continue' in the hessaoe a.} 



(Bhen stiJent hits Retarn, 
write the student's equation in canonical 



type in rrotpi moon dnd tUsh st:J 

•Please type in your answer and press return' ' 

I j 

(Analyze input character by character. ^ 

Accept onlv *u c^^racter which i'epresents I 

the variable asked {or, an-} an equal sign. ' 

In this case, H» . If a is hit Vu I 

do not print and yi<e the lolloHin} ^ 

in the Proipt Nindow) j 

'You donU need a sinus sign on the left hand ^ 

side of the equal sign. Try again* I 

(If any other key is hit, bpep, and give the ^ 

following eessage in the Proept Window) 1 
*Read the problee and the hint above, and try again* ^ 

I I 

Y ^ 

YES /Stu«ent ^akes sore than 3 oistakes?/ I 

I ^ 

V I 
NO ^ 

I 

t 

(If the student types in K=, accept everything I 

after the equal sign according the instructions ^ 

in 2 and 4 above. When student finishes typing { 

equation and presses rel^xn, freeze the equation ^ 

in the Equation Line for ^otparison I 

Nith the one in the Equation Dox. * 

Erase eessage in h . ? I 

I ^ 

V I 

I ^ 

V . I 

/Is th<j equation in the Equation Line ' 
H= E»1C00 or K=1000+[?/ I 

YES 
I 

V 

(Rindot good response in Proapt Hindox. 
Go to next ptoblea) 

<-<-<-<-<-2 NO 
I 
I 
I 

V 

(In Prompt. U:} 

*The equation you've just typed in is not the 
sase as your orignal equation. Try again.* 
(Erase everything in Hessage U, and tfpe in it 
the hints in the S-YES branch above, i.e. *Look 
at the highlighted...} 

I 

V 

->->->->•>->->•>->'>->->->->'>->->->-> 



fora in the Equation Line. Erase hesilge 

HindoMi and write in it:) 

•So you see ho» we have put H alone on the 

left hand side of the equal sign. He're 

doing that because the highlighted portion 

of the problei asks for «.* 

(Highlight p_;tion: 'urite an eq ... in ter«s 

of v.) 

I 

V 

.(In Pro^i.'t Uindow write the following 
aessage and fUsh it if the student 
does not repond in iS seconds^) 

I 

V 

I 

V 

•Press Return to continue* 

I 

V 

(After student types return, continue) 



|<-<-<-<-<-<-<-<-<-<- 

V 
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16. /Is it •H=E-1000* or 'H=-JOOO*E' 
or •n=IMGOO)*E* ?/ 

HO 



YES 



-<-<-(-<-<-<-<-<- 



(In Kessage yindoM, Hrite) 
*Untortunateiy, your answer is not 
'Correct. Suppos^ that the estiiate, Et 
(4000. According to your equation, 
Ion ftuch coney, K, »as actually 
collected'^ Please give your answer 
IS a nuaber.' 

I 

V 



[Input] —-<-■—<- 



HO < — <- /Is the input a nuoerical value''/ 

Un Proipt UindOK) 

''Please type a nuiber ! 
for H.' 

YES 



(In Message HindoM) YES — <- 
•You're right! If E is 4000 
your equation predicts that 
K IS 3000. eut the problee 
states that sore soney uas 
collected than was estiaated. 
So n lust be greater than E Mhich 
IS not Hhat your equation predicts. 
Tr, again.* 



/ Is it 3000?/ 



<- 2 <- 



-> I -> 



<-<-<-<-<-<-<-<•<-<•<-<- 



-(-<-(-<-<"<-<-<-<-<-<-<-<-<-<"<-<-<-<-<-<- 



i 



(In Hessagc kindoti; — <— 
*Your ansKer is still wrong. Substituting 
E=4000 into your equation gives: 

«=4000-IOOO=3000. 
However, the problea says that the ioney 
collected, H, was $1000 sore (highlight 'sore') 
than the esti&ate, E. So you see »hy your equation 
can*t be correct. Try to urite a correct equation. 
(H no response in 30 sec. nrite in Proapt ti.:> 'We're 
waiting {or you to type in an equation. 



(In Proapt Hindou. write:} 
•Ko. Substituting E=4000 into 
your equation does not give 

. Try again." 

{Vu2 • ' is the answer given by 

the student. Route student baiif ;ip 
to input and erase his previous input)—) 



17. /is it 'n=1000-E' or 

'H=l-EHI00'^ or N=-EM00V 



NO ->->->->->->->->->- 18. 



/Is it 'N=-E-1000' or 
or 'H«(-E) -1000' or 
'f1^'-lOOO}-E' or '«=« 

I 



•H=(-E)HMOOO) 
•H=-1000-E' or 
(-IOOO)M-E)?/ 



[C 



I 

YES 



(In hessage yindoH:) 
•Your answer is not correct. Suppose 
that the estitate, E, is $4000. According 
to your equation, hOM such ftoney, H, was 
actually collected? Please give your answer 
as a nuaerical value.' 



HO 

(There should not be 
a NO branch here if 
all the tests uere 
carried out appropriately) 



YES 
I 



(In Flessage Hindoo:) 
"Your answer is not correct. Suppose 
that the estiflate, E, is $<000. According 
to your equation, hoM Auch aoneyi K, was 
actually collected'^ Please give your ansuer 
as a nuoericdl value.* 



-< (--<-<-<-<-<-<-<-<-<-<-<-<-<-<-<-'- -yyyyyy) > 



(INPUT) 



lis it a numerical value?/ 



I 

f 

YES 



Q (In Proapt Hindon:) 
*Please type in a nuiber 
lor H.' 



(INPUT) 



<- 



/Is it a nuaerical value?/ H0->- (In Proapt Window:) 
I 'Please type in a nu&ber 

Y ior H/ 

I 
I 

-- YES-->-- 



/Is it •-3000' or '-(SOOO)'?/ HO, 1 -->— - 

I I 
I I 

VES NO 

2 

I 
I 

v 



(In Proapt Hindow:) 1, HO /Is it '-5000' or •-(50OO)*?/ 

•No. Substituting EMOOO ! 

into your equation does not ! 

give . Try again* MO 

15 the student's anSHer) 2, 

I 
I 

y 



YES 

I 
I 

), 



(In Hessagc Uindo»:) 
■Your answer is still wrong. Substituting 
E=4000 into your equation gives: 

H=IODD-4000=-3000. 
This iaplies that the auction lost (highlight 'lost') $3v^^0 
However, th( probles states that the coney 
collected, H, xas ilOOO sore (highlight •aore') than 
the esti&ate, E. So yOu see why your equation 
is wrong. Try to write a correct equation.' 

I 

V 

I 
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(In Hessage tiindow:) 
•Your answer is still wrong. Substituting 
E'^4000 into your equation gives: 

M=-4000-I000=-5000. ' 
This isplies that the auction lost (highlight 
•losf). However, the problea states that 
the aoney collected, H, was ilOOO sore 
(highlight •aore'l than the estiaate, E. 
So you see why your equation is wrong. Try 
to write a correct equation.' 



I 



I 



»->-)-)-)->->->->->->->-> <-<-<-<-<-<-<-<-<-<-<- <-<-<-<-(-<-<-<-<-<-<-< 



:->->->->->->->->->->• 



(In Besuge Uindou;) 
•You're right! If E=4000, your equation 
predicts that M is -3000, but this «ould «ean 
tlut the auction lost (highlight Most") J3000. 
HoBevcr, the probU* states that the toney collscted, 
• H, Mas IIOOO eore (highlight 'oDrs') than the 
esliuate, E. Think about this and try to type \i\ 
the correct equation." 

I 

V 

1 



I 



(In Kessage Windon:) 
■You're right! H EMOOO, your equation 
predicts that H is -5000, «hich .lould «ean 
that the auction lost (highlight 'lost') »5000. 
HoNBW, the problei states that the eoney 
collected, H, was ItOOO sore (highlight '^areM 
than the estiaats, E. Think about ti.is jnd try 
to type in the correct equation.' 
I 

V 



-<-<-{-<-<- — <-<-<-<-<-<-<-<-<• 



<-<-<-<-<-<-<-(-<-<-<-<-<-<-<-<-<-<-<-<-<-< -<-<-<-<-<-<-^-^"^'^"^'^'^" 
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